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1.  INTRODUCTION 

We  consider  the  estimation  of  the  weighted  integral  of  a  stochastic 
process  X  over  a  finite  interval 

i  =  sl  *(t)X(t)dt 


from  observations  of  the  process  at  a  finite  number  of  sampling  points.  The 

process  X  =  {  X(t),  a<t<b  }  has  mean  0,  continuous  covariance  function  R(s,t)  = 

E[X(s)X(t)],  and  exactly  K  quadratic  mean  (q.m.)  derivatives  (K=0,l,2,.  .). 

The  weight  <p  is  a  known  (nonrandom)  continuous  function.  The  performance  of  an 

estimator  is  measured  through  the  mean  square  error. 

In  BC  (1989),  we  concentrated  on  linear  estimators  of  the  form 

IR  =  2^_qC.  nX(tj  n)  that  are  based  only  on  the  observations  of  the  process  X 

at  (n+1)  sample  points  of  a  regular  sequence  of  sampling  designs 
n  oo 

(T-(h)  =  {t.  }  a=t-.  <tf  <...<t  =b}  i  generated  by  a  positive 

1  n'  '  1  i,n'i=0  0,n  l.n  n,n  Jn-1  * 

continuous  density  h  via 

t 

J*  'n  h(t)dt  =  i/n,  i=0,l . n. 

a 


Here  we  consider  linear  estimators  of  I  based  on  observations  of  the  process 

together  with  its  existing  q.m.  derivatives  X^^(t) . X^^(t)  at  (n+1) 

sampling  points  T^sftj  n}^_Q  over  the  finite  interval  [a.b],  and  using 

1=0  K 

coefficients  C  =  {c.  ,  K  ~ .  .  They  are  of  the  form 

n  1  i,  j,n'i=0 . n  J 


d!n  = 


n 

2 


K 

2 


i=0  j=0 


c ,  .  X(J)(t.  ). 

i , j ,n  v  i ,ny 


We  want  to  determine  the  asymptotic  performance  of  these  types  of  estimators 
based  on  regular  sampling  designs  (Tn(li)}  and  appropriate  coeff iciTts 
We  are  also  interested  in  finding  asymptotically  optimal  designs  {T^}^  and 
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estimator-coefficients  {C  }  ,  in  the  sense  that 

1  n'n 


E(I-,I*)2  /  inf  E(I-,I  )2  — ►  1 

v  d  nJ  c  y  d  n'  n 

n  n 


where  the  infinum  is  taken  over  all  sampling  designs  with  (n+1)  sample 

points  and  all  choices  of  coefficients  C  .  (Optimal  designs  for  fixed  sample 

size,  when  they  exist,  are  in  general  hard  to  determine.) 

When  no  q.m.  derivatives  are  used,  the  optimal-coefficient  estimators  are 

of  the  form  I  =  f^,  R^Xj,  ,  where  Xj,  =  (X{  t^  . X(t^  n^  ' 

n  n  n  n 

Rj  =  {R(ti  n-tj  n)}^  i=0  assumed  nonsingular,  i^,  =  (f(tQ  n) . f(tn  n))  ^ 

f(t)  =  J*^R(s ,  t)«/>(s)ds .  In  BC  (1989)  the  asymptotic  performance  of  these 

3. 

optimal-coefficient  estimators  using  regular  sequences  of  sampling  designs, 

A 

In(h) ,  is  obtained  for  a  general  class  of  processes  with  exactly  K  q.m. 
derivatives.  K=0,l,2,..,  namely 


(1.1) 


2K+2  _rT  C 
n  E[I-In(h)] 


n 


IW  *  , 

(2K+2) !  Ja  h2K+2(t)  * 


where  B  is  the  m*"*1  Bernoulli  number.  In  particular  when  the  sampling  densi  ty 
m 

*  2  1/f 2K+3) 

h  is  proportional  to  (ct^  )  V  ,  then  the  asymptotic  performance  becomes 

|B, 


,,  2K+2  ,.ri  J  „.*,,2  .  '  2K+2 

(1.2)  n  E[I-In(h  )]  — 


& 

with  minimal  value  C  of  the  asymptotic  constant.  This  result,  together  with 

A  * 

the  asymptotic  optimality  of  In(h  )  was  shown  for  K  =  0  and  1  by  Sacks  and 

Ylvisaker  (1966,1968,1970)  and  for  general  K  by  Eubank,  Smith  and  Smith  (1982) 

but  for  a  more  restrictive  class  of  covariances. 

Optimal-coefficient  estimators  which  use  the  values  of  the  process  and  of 

its  existing  q.m.  derivatives  at  the  sampling  points,  were  considered  by  Sacks 

and  Ylvisaker  (1970).  Their  mean  square  errors  have  the  same  rate  of 

-(2K+2) 

convergence  to  zero,  nv  ,  as  in  (1.1)  and  (1.2)  for  the 
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optimal-coefficient  estimators  which  do  not  use  the  existing  q.m.  derivatives, 
but  they  have  smaller  asymptotic  constant.  In  Section  3  we  give  a  simple  proof 
of  this  result  under  slightly  different  assumptions  than  those  considered  by 
Sacks  and  Ylvisaker  (1970a)  where  the  jump  function  a^(*)  was  assumed  to  be 
constant,  and  under  additional  assumptions  on  the  weight  function  4>.  The  proof 
given  here  involves  only  a  simple  numerical  approximation  of  integrals  of 
deterministic  functions  using  derivatives  (Proposition  1). 

These  optimal-coefficient  estimators  require  the  inversion  of  a 
(K+l ) (n+1 )x(K+l ) (n+1 )  covariance  matrix,  and  hence  they  are  liable  to 
numerically  instabilities  for  large  sample  size.  More  significantly,  they 
require  knowledge  of  the  covariance  matrix  (and  its  partial  derivatives)  and 
thus  they  are  not  generally  robust.  Stein  (1988)  showed  that  if  an  incorrect 
covariance  is  used  which  is  compatible  (in  an  appropriate  but  restrictive 
sense)  with  the  true  covariance,  then  the  asymptotic  performance  of  the 
optimal-coefficient  estimators  under  these  two  covariances  is  identical. 

However  this  condition  fails  to  be  satisfied  when  for  instance  asymptotically 
consistent  estimators  of  the  unknown  covariance  function  are  used.  For 
example,  the  covariance  function  R(t)  =  e  1  of  a  zero  mean  Gaussian  process 

A 

^  _g  I  ^  I 

and  the  covariance  function  R(t)  =  e  1  where  0  is  an  asymptotically 
consistent  estimator  of  0,  are  not  compatible. 

In  order  to  address  the  Issues  of  robustness  and  of  knowledge  of  the 
covariance  function,  a  sequence  of  estimators  was  introduced  in  BC  (1989)  which 
uses  regular  sampling  designs  T^(h)  and  simple  coefficients  (not  depending  on 
the  covariance),  and  is  based  on  the  weighted  Gregory  formula.  These 
estimators  use  only  observations  of  the  process  (but  not  its  existing 
derivatives)  at  the  sample  points.  Their  asymptotic  performance  was  shown  to 
be  identical  to  that  in  (1.1)  and  (1.2)  for  the  optimal-coefficient  estimators 
for  general  processes  with  exactly  K  q.m.  derivatives,  K=0,l,2 .  These 


4 


highly  nonparamet  ’ic  estimators  are  given  by 

Vh>  =  s  <  1 x<a> +  x(ti.n> +  J  mw  x<b>  > 

-  ln  ,Vj(  iJCnln!  X(tn-J.n»  +  (-1)JAJ[  X(a>]  } 

j=l  J  v  n-j,n'  J  v  ’ 


where  A^  denotes  order  difference,  A^g(tj  n)  =  r(^)g(ti+r  n). 


0<i+j<n,  and 


Wj  =  [(-l)J/(j+l)?]  J*q  t  { t— !)...(  t-j  )dt 


for  j>l,  and  can  be  written  in  the  form 


n 


(1-4) 


I  (h)  =  —  2  a.  (ft(t.  ) 
nv  '  n  i-0  i  vh  /v  i.n' 


where  the  coefficients  a^ .  i=0 . n,  are  given  by 


(1.4")  at  = 


i_  /  w 

2  j=l  j 


1  +  (-1) 


n-i 


i+1 


2*^  (^)w 

j=lli'Wj 


for  i  =  0,n, 

for  1  £  i  <  K, 
for  K+l  <  i  <  n-K-1, 
for  n-K  i  i  ^  n-1. 


For  example,  the  values  of  a^ ,  i=0, . . 
large  n)  are  as  follows: 


ii 

o 

1 

2' 

1. 

1. 

1. 

1. 

K  =  1: 

5 

12’ 

13 

12’ 

1. 

1. 

1, 

K  =  2: 

3 

8’ 

7 

6’ 

23 

24' 

1. 

1, 

K  =  3: 

251 

720' 

299 

240’ 

211 

240’ 

739 

720’ 

1. 

ii 

95 

288’ 

317 

240’ 

23 

30’ 

793 

720’ 

157 

160' 

,n,  for  K=0,l,2,3,4,  (and  appropriately 


1... 

■  ,1. 

1. 

1. 

1. 

1, 

1 

2 

1... 

.  .1. 

1. 

1. 

1  , 

13 

12’ 

5 

12 

1,  .  . 

.  .1. 

1. 

.  23 

’  24’ 

7 

6’ 

3 

8 

1.  .  • 

.  ,1. 

1. 

739  .211 
720’  240' 

299 

240’ 

251 

720 

157  793  23  317  95 

. 11  160’  720’ 


30’  240’  288 


In  Section  4,  we  introduce  simple-coefficient  estimators  which  use  the 
values  of  the  process  X  and  of  its  existing  q.m.  derivatives  at  all  sampling 
points  of  a  regular  sampling  design  Tn(h).  They  are  based  on  the  trapezoidal 
rule  for  integral  approximation  with  a  correction  term  that  depends  on  the 
values  of  the  K  q.m.  derivatives  at  all  sample  points,  namely  on  the  weighted 
Rodriguez  formula  (Section  2).  Their  asymptotic  performance  is  shown  in 
Theorem  2  to  be  identical  with  that  of  the  optimal-coefficient  estimators  which 
use  the  values  of  the  q.m.  derivatives  of  X.  The  simple-coefficient  estimators 
do  not  require  precise  knowledge  of  the  covariance  function  R  (or  of  its 
derivatives),  and  thus  they  are  fairly  robust.  They  are  also  numerically 
stable  in  view  of  their  simple  form.  However,  they  are  impractical  for 
applications  where  q.m.  derivatives  of  X  at  the  sample  points  cannot  be 
observed.  In  such  caces  the  q.m.  derivatives  can  be  approximated  by  finite 
differences.  The  resulting  estimators  (4.2)  use  only  the  values  of  the  process 
at  the  sampling  points,  and  therefore  cannot  have  better  asymptotic  performance 
than  that  in  (1.1)  and  (1.2)  for  the  simple-coefficient  estimators  considered 
in  BC  (1989).  However,  they  may  have  comparable  performance  for  small  or 
moderate  sample  size,  as  the  example  in  Section  5  illustrates. 

In  Section  5,  we  compare  the  finite  sample  size  performance  of  the  two 
types  of  simple-coefficient  estimators  based  only  on  the  values  of  a  stationary 
process  with  K=2  q.m.  derivatives  under  both  asymptotically  optimal  sampling 
designs  {Tn(h  )}  and  uniform  sampling.  We  find  that  in  this  example  the  two 
estimators  have  the  same  asymptotic  performance.  We  also  find  that  the 
estimators  (optimal  and  simple-coefficient)  that  use  the  existing  q.m. 
derivatives  clearly  perform  better  than  the  estimators  that  do  not  for  moderate 
and  large  samples. 

In  Section  2  we  develop  a  quadrature  formula  for  integral  approximation  of 
deterministic  functions  based  on  the  derivatives  of  the  integrand  under  regular 
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sampling  designs.  These  results  are  used  in  Sections  3  and  4. 


2.  APPROXIMATION  OF  INTEGRALS  OF  NONRANDOM  FUNCTIONS  USING  DERIVATIVES  AND 
REGULAR  SAMPLES. 

The  classical  rules  for  approximating  integrals  of  deterministic  functions 
use  periodic  sampling  designs,  and  some  of  these  have  been  extended  to  regular 
sampling  designs  in  BC  (1989).  Here  we  consider  the  trapezoidal  rule  with  a 
correction  term  that  depends  on  weighted  derivatives  of  the  integrand  at  all 
sampling  points  of  the  regular  design.  These  rules  are  derived  from  the 
standard  Rodriguez  formula  for  periodic  sampling  in  Shoenberg  (1969),  and  are 
generalized  to  regular  sampling  in  Proposition  1.  Their  asymptotic  properties 
are  given  in  Proposition  2. 

We  will  use  the  ”h-weighted”  derivatives  of  a  function  f  defined  by 


f (0)  -  f/h’  f(j)  '  fCJ-i)/h 


for  j  >  1 , 


provided  f  and  h  have  the  required  derivatives,  and  the  h-weighted  differential 
operator  d. 


J 


V  =  f(j)  for  J20' 


so  that  djt(1)  =  f(1+J). 


Also  the  probability  function  H(x,y)  is  defined  by 


H(x.y) 


h(t)dt  for  a£x<y<b, 

-H(y,x)  for  a£y<x<b, 


and  satisfies  for  all  x  /  y  and  j  >  0, 


§*  H(x.y)  =  -h(x).  Syx  HJ(t,y)h(t)dt  =  ^  Hj+1(x.y). 

In  the  particular  case  where  h  is  the  uniform  density  on  [a,b]:  h(t)  =  (b-a) 
then  f^j  =  (b-a)^  +  1f^,  j  i  0.  and  H(x,y)  =  (y-x)/(b-a). 


Proposition  1.  (Weighted  Rodriguez  formula  for  regular  sampling).  If  f  and  h 
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have  m(>l)  continuous  derivatives  on  [a,b],  and  if  {Tn(M)n_i  *s  a  regular 
sequence  of  sampling  designs,  then  we  have 


i  m-1  , 

m!  „  1 


( 2m- j-1 ) ! 


n-1 


4  f(t)dt  ~  (2m)!  slQ  nj+l  (m-j-l)!(j+i)!  ifQ  [f(j)(ti.n)  +  (_1)  f(j)(ti+l,n 
+  isjr^  4)^'n  V^i^1)  fw(t)h(t)  dt- 


)] 


Furthermore,  if  f  and  h  have  2m  continuous  derivatives  on  [a,b],  then  the 
remainder  integral  term  can  be  written  as 


/  ,  , m  n  1  t»  , 

izIL  2  J.1+1>n  [Hfti  n.t)H(t.ti+1  n)]m  f 


(2m)! 


i=0  i.n 


(2m) 


( t )h( t )  dt . 


Proof .  Fix  [x,y]  C  [a.b],  and  define  the  weighted  Legendre  polynomial 

W')  =  sr  ■ 

It  can  also  be  expressed  as  follows 

P(0)(t)  “STV «(x.t)(«(x.y)  -H(x.t))]m 

=  H(x.y)m_i  dm[H(x.t)]m+i 

m  (m+i)!  .  , 

=  2  - s-  (-1)1  H(x.y)m  H(x,t)\ 

i=0  (m-i)!  i r 


from  which  we  obtain  for  0  i  j  <  m. 


P 


(j) 


(t) 


and  in  particular 


2 

i=j 


{"»<)’  (-D1 

(m-i)!  i!  (i-j)! 


H(x,y)m  * 


H(x.t)1  J 


Likewise,  we  obtain 


P  fx)  =  — ) !  (-11^  Hfx  v)m  ^ 

(J)1  j  (m-J)!  j!  1  {  Y) 
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P(J)(y)  -  (-1)m  M7UT  H'1‘-1'>ra'J  ■  PU)M 


Now  consider  the  remainder 


V  (WJxdJH<X't)H(t-y>]'"  f«<t)h<t)  dt  =  (SIT^X  P(0)<t>f(n,)(‘>h<t>  dt 


For  m  2  1,  repeated  integration  by  parts  yields 


m! 


pm  =  f(t)dt  -  (2m)! 


(-1) 


m 


m-1 

.  jfo t_,,J  Vj-.)(t) 


from  which  we  obtain 


m-1 


sl f«>dt  -  dr  Cf(j)C-) *  (-»Jf(j)(y)] ♦  v 


The  result  follows  by  first  splitting  the  integral  as  follows,  /  f(t)  dt 

21 

n-l  t  j 

=  2  S  '  f(t)  dt.  and  then  applying  the  above  formula  in  each  subinterval 

i=0  Ci.n 

[t.  .  t..,  ]  and  using  H(t,  ,  tJ  ,  )  =  1/n  .  The  second  expression  is 

L  i.n  l+l. nJ  &  v  i.n  i+l,n/ 

obtained  by  m- times  repeated  integration  by  parts  of  the  remainder  p^.  n 

Based  on  Proposition  1  we  introduce  the  following  rule  of  degree  m  using 
derivatives  of  f  based  on  regular  sampling  T^(h) , 

mTn(f:h)  =  (f^JT  ^FT  (m-j-l)!~(  j+l)!_  ^  [f(j)(ti.n)  +  1 }  J  f  ( j ) {  C  i  +  1  ,n}  ] 

as  an  approximation  to  the  integral  I { f )  =  J^f(t)dt.  For  m=l  and  m=2,  these 

rules  a  e  identical  to  the  rules  used  in  BC  (1989).  Also  for  j:  odd  the  i  sum 

telescopes  and  reduces  to  f ^ ^ ^ (a)-f ^ j ^ (b) .  Their  asymptotic  performance  is  as 
fol lows . 

Prouositlon  2.  If  f  and  h  have  p>m  continuous  derivates  on  [a.b],  then 


n  l 1(f) — m In ( f ; h ) ]  -  0 

n 


for  m  <  p  <  2m. 
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n 


(2m)!  (2m+l ) !  ^f(2m-l)(b^  f(2m-l)(a)^  for  P  "  2m‘ 


Proof.  For  simplicity  of  notation  we  write  t,  for  t,  and  I  for  I  (f;h). 
-  r  J  i  i.n  n  m  n 

If  f  and  h  have  (m+j),  0  £  j  £  m,  continuous  derivatives,  then  j- times  repeated 
integration  by  parts  of  the  remainder  p in  Proposition  1  gives 


dn,-j  tH<V‘>  Vj>(t)h(t) 


dt. 


The  function  dm_^[H(t^,t)  H(t.t^  +  ^)]m  has  q  £  j  distinct  roots  in  [ t ^ ,  t.  +  ^], 
say  c^  ^  <  ...  <  ci  so  that  putting  c^  q  =  ti’  Ci  q+1  =  ti+l’  we  bave 


3  2  2  S  if*+1  d  ,[H(  t .  ,  t  )H(  t ,  t ..  )  ]m  f,  ,A(t)h(t) 

m  (2m)!  i=o  e=o  ci.e  m_J  1  1  (m+J) 


dt. 


Since  d^_ j[H( t^ . t )H( t , t ^  +  ^ )  ]m  has  constant  sign  in  each  subinterval 
(ci  £,  c.  g+i) •  ^e  Mean  Value  Theorem  can  be  applied  to  obtain 

J  n-1  q 


0.  ■  {sfr  A,);*1  h(t)  dt 


i  8 

where  c^  g  <  g  <  ^  we  write  ’  h(t)  dt  =  a^/n,  it  follows  that 

0  =  cTq  <  dj  <  ...  <  <  aq+^  and  putting  u  =  nHft^.t),  we  obtain 

(~1)J  nll  5  r  rc  \  1  r“^+1  r  f  i  a., 

pm  (2m)!  i=Q  g=Q  f(m+j)(fi,^  nm+J+1  ae  ^  ^ 

From  the  Mean  Value  Theorem,  we  have  ^  =  h(fj)(tj+j,tj  ).  tt  <  rt  <  ti+1.  so 
that  by  Riemann  integrabi 1 i ty ,  we  have 


nm+J[I-I  ]  - 


J 


-  (5S)T  so  d""J  tu<'-u)f  du  [f(nHJ.u(b)  -  f(n,tJ-i>(a)] 
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-  ^(2m-l)(b)  -  f(2m-l)(a>J  if  J=> 


=  0 


if  0  i  j  < 


m. 


Usincr  Bfm  ml  -  EiiPlJ-1  r(ro+l)  m!2 

r(2m+2 )  =  (2m+l)!  ’  we  °htain  the  final  result. 

Now  assume  j  >  m.  Then  m-times  repeated  integration  by  parts  of  the 

remainder  in  Proposition  1  yields 


,  =  iziX 

m  (2m)! 


,!o  C  CH(t,- t)H(t'  S+l)]”  f(2»)(t)h<t>  dt 


Using  the  explicit  expression  of  P(0)(t)  in  the  proof  of  Proposition  1,  „e  have 


ni  m  r-»  — .  i  #• 

p  =  .1 _ -J  y  rm\  /i-\£  1  _  r  i  +  1 

m  (2m)!  pZq  (  UTT  *  f 

e=v  n  i=0 


=  til 


,  m+£ 


«  H<V‘>  '  Wt)h(,)  dt 


Again,  repeated  integration  by  parts  gives 


i+1 


1 t"‘  f(2m)(t)h(t)  dt 


J-m-1 

2 


H(trt) 


m+£+ 1+p 


^9mJ.r,(  t) 


i+1 


p=0  [  (m+£+l). . . (m+5+l+p)  (2m+P  Jt^ 

it,, 

j.  /_m J  m  r  i  +  1  1  .  i+P 

1  '  Jtj  (m+£+l ) . . . ( j+£)  H(ti't)  f(J+m)(t)h(t)  dt 

_  J'j_1  (m+l)! _ 1 

p=0  (n»+£+l+p) !  nm+«+l+p  f(2m+p)^ti  +  l^ 


and  using  the  Mean  Value  Theorem,  we  have,  with  t{  <  f  <  t 

1 


i  +  1 


_ f  (t  w  J~y  1  (m+l)!  1 

(m+P+1 )nm+^+1  (2m)  1+1  p=i  (m+£+l+p) !  nm+£+l+p  f (2m+p) ^ 1 i 4 l ) 
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+  ( J  +  ^)  • _ 1 -  f  (F  ) 

(  1}  (m+£) !  (j+,+  1)nJ^l  f(n»+j)(fiJ 

*  (B(.l)n**W  f2”)'  1+1>  0<"  ’ 


Therefore  we  obtain 


(-l)m  ™  ,mw  ,.e  1  1  V  ,  ft  ^  .  ,  -2nu 

Pm  =  (2m)T  ^  m+e+l  n2m+l  ^  f(2m)(  i+l}  {  } 


=  (isiT  4  <•“  A  W'i*l»  +  0'n'2m)' 


n  i=0 


Using  —  =  h(f .)  (t.-.-t.),  we  obtain 
&  n  Viw  i'  v  l+l  l ’ 


^-y  -  wt,h(t)dt 


r  i  |2 

-1)  m! 


=  (2m) ! (2m+l )T  tf(2m-l){b)  ~  f(2m-l)(a)]  * 


3.  OPTIMAL-COEFFICIENT  ESTIMATORS 


The  optimal-coefficient  estimators  ,1  minimize  the  mean  square  error 

a  n 
o 

Efl-^I^  among  all  linear  estimators  that  use  the  q.m.  derivatives  of  the 
process  X  at  the  sampling  points.  They  are  of  the  form 


(3.1) 


d*n  =  fK,T  ^.T  YT 


n  n  n 


where 


YT  *  <x(J,<*0.n> . x(J,<tn.n»J=0 . K:  1  *  <K+1>(,wl>  ''ect°r- 

n 

"k.t  *  :  «  owimi 

n 

covariance  matrix  assumed  nonsingular. 
fK.T  *  <f(J,(t0.n> . f<J)(tn,n>>J=0 . K  :  1  *  (K*1)(n*‘>  vector. 


f(t)  =  r  R(s.t)  ♦(s)ds. 

a 


The  asymptotic  performance  of  these  optimal-coefficient  estimators  using 

A 

regular  sequences  of  sampling  designs,  ^I^fh),  *s  given  by  Theorem  1  under 
slightly  different  assumptions  than  those  considered  by  Sacks  and  Ylvisaker, 
where  also  the  jump  function  a^(*)  was  assumed  to  be  constant. 

Theorem  1 .  Under  Assumption  we  have 

2 

2K+2  „rT  j  ,,  .-.2  (K+l)!2  rb 

n  Etl  dJn(h^  n  (2K+2) ! (2K+3) !  4.  h2K+2(t)  dt‘ 

If  h*  is  proportional  to  (a^2)  f  then  the  asymptotic  performance 

becomes 

2K+2  rr,  ?  „*,,2  (K+l)!2  ,rb  r  ,  ,  .2, ,l/(2K+3)  ,  2K+3 

"  »  S  (2K+2) ! (2K+3) !  <4  [°K(t)»  (t)]  dt) 


with  minimal  value  of  the  asymptotic  constant.  The  asymptotic  optimality  of 
the  designs  (Tn(h  )}  is  shown  in  Sacks  and  Ylvisaker  (1970),  where  the  jump 
function  was  assumed  constant,  and  under  a  Lipschitz  type  assumption  near 
the  zeroes  of  weight  function  $  (cf.  (3.15)  in  SY  (1970b)). 

The  condition  A^  and  function  used  in  Theorem  1  are  defined  as  follows, 
where  the  following  notations  are  used:  R^’q^(s,t)  =  3P+qR(s,  t)/ds^dtq, 

R(p'q)(t, t-)  =  lim  t  R^P'q^(t,s)  and  R^p,q^(t,t+)  =  lim  i  R^P'q^(t,s). 

S|t  Sit 

Assumption  A^  (K=0,  1 ,2,  ...).( i )  R^'1^  exist  and  are  continuous  on  the  square 
[a.b]  x  [a.b]. 

(ii)  Each  R^P’q^(t,s)  with  p+q=2K  exists  on  the  square  [a,b]x[a,b];  has 

continuous  mixed  partial  derivatives  up  to  order  2  off  the  diagonal  (t^s):  and 

at  the  diagonal  (t=s)  it  has  left  and  right  derivatives  which  are  continuous 

functions  of  t,  i.e.  R^p,q^ ( t+ , t ) ,  R^P’q^( t-, t)  exist  and  are  finite  for  all 

f 0  2K+ 1 1 

p+q  =  2K+1  and  are  continuous  functions  of  t,  and  sup  |R'  ’  '(s.t)|  < 

”r  t 

For  each  t  €  [a.b],  r(®i2^+2)( . , t+)  e  H(R),  the  reproducing  kernel  Hilbert 


13 


fO  2K+2) 

space  of  the  covariance  R  with  norm  IMIn,  and  sup.!IRv  '  7  (  • .  t-*- )  <  ».  Also 

K  t  K 

each  R(J*2K+2)(tiS) >  j  =  i . K,  exist  and  are  continuous  on  [a,b]x[a,b]  for 

t  ^  s. 

(iii)  a^(t)  =  R^’^+^(t,t-)  -  R^’^+^(t,t+)  is  positive  and  continuous 
on  [a.b]. 

(iv)  <f>  and  h  have  K+2  continuous  derivatives  on  [a.b]. 


Part  (i)  of  Assumption  A^  is  the  necessary  and  sufficient  condition  for 
the  process  X  to  have  K  mean-square  continuous  q.m.  derivatives.  Part  ( i i ) 
requires  smoothness  properties  off  the  diagonal  and  thus  it  is  weak.  Part 
(iii)  guarantees  the  process  X  has  no  more  than  K  q.m.  derivatives. 
Assumptions  (i)-(iii)  are  satisfied  by  a  large  class  of  processes  including  K 
order  iterated  integrals  of  Wiener  process,  and  stationary  processes  with 
rational  spectral  densities.  When  X  is  stationary,  R(t,s)  =  R(t-s),  then 
conditions  (i)-(iii)  are  satisfied  iff  R^^+^(t)  exists  and  is  continuous  for 
t^O  and  R^^+^((H),  R^^+^(0-)  exist,  are  finite  and  the  jump 
ctft)  =R(2KtIV)  -R^V)  U  positive. 

In  the  proof  of  Theorem  1,  we  will  use  the  following  ”h-weighted" 
derivatives  of  the  covariance  R, 


th 


R(p  q)(t.s)  =  E{Y^p)(t)Y^(s)}  for  0  ^  p.q  £  K.  and  t.s  €  [a.b]. 

Furthermore,  we  define  recursively  R^p  ^(t,s)  for  (K  <  p  or  K  <  q  and 
0  i  p+q  i  2K,  t.s  €  [a.b]}  and  for  (2K+1  £  p+q  £  2K+2,  t  *  s  in  [a.b]}  as 
fol lows: 


R(p.q) 

R(p.q) 


(t.s) 

(t.s) 


Proof  of  Theorem  1 . 


-  J—  R 

-  h(s)  R 

-  -i—  R 

-  h(t)  R 

Let  PK,n 


(p:i-D(ts>  r°rK<''' 
(i-°!q)('-S)  f0r  K  <  P' 

be  the  projection  from  the  Hilbert 


space  H(R^0j) 
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onto  sp{R^Q  jj(.,t),  1  e  ^n‘  ^  =  ® . K} .  In  view  of  the  isomorphism  between 

H(R  )  and  H(Y^q^),  as  in  the  proof  of  Theorem  1  in  BC  (1989),  the  mean  square 

A 

error  of  the  estimation  of  I  by  ^I^h)  can  be  written  as  follows: 

E[I-d;n(h>]2  =  «f-PK.„f"R(0)  -  <f-PK.„f-  f>R(0)=  Jt  (f-pK.nf)<s>  h<s>  ds 


where  f(t)  =  J*5  R,m(t,s)  h(s)  ds.  Let  g  =  f  -  P,.  f.  Then  g  is  orthogonal  to 
Q.  y\J )  iv ,  n 

sp{R^0  jj(*,t),  t  €  Tn>  j  =  0 . K}  and  in  particular  g^^tj)  = 

<  g,  R,»  .  »(*,t  )  >_  =0  for  j  =  0 . K.  Applying  Proposition  1  with 

(°.J)  1  K(o) 

m  =  K+l  to  the  function  g,  we  obtain 


E[I-din(h)]2  =  g(s)  h(s)  ds 


t«*i ) ■  n;1  *  _l 

“  t  nr/  .  o  \  l  **  3  i 


(2K+l-,j ) ! 


(2K+2) !  ^  ^  nJ+l  (K-j) !  ( j+1) ! 

,  , .K+l  n-1  t 

n,x)H(x.t 

,  nK+l  n-1  t  . 


1+1. g(2K+2)(x)h(x>  dx 

K+i 

i+l.n>3  g(2K+2)(x)h(x>  dx' 


From  Assumption  A^,  we  have 

f(2K+l)^  =  ^a  R(0,2K+1)^s’  t+)h(s)ds  +  J*t  R(0,2K+1)^S*  t')h(s)ds 
and  taking  the  h-weighted  derivative, 

f(2K+2)^t)  =  +  ^a  R(0, 2K+2) ( s >  t+)h(s )ds 

where  P^( t)  =  R^Q  2K+l)^t,t-^  “  R(0  2K+l)^t,t+^‘  From  AssumPtion  Ak> 
VjjC.s)  €  H(R^qj  )  for  j=0 . K  and  R(0>2K+2)^  *  • t+>  C  H^R(0)  ^  *  and  thuS 

<R(0.j)(*,s)*  R(0,2K+2)(*’t+)>R(0)  =  R(j.2K+2)(s't+)’ 

and  since  P„  f  €  spfR,-.  ,*(*.t).t  €  T  ,  j=0 . K},  we  have  for  t  €  T  . 

K.n  (0,j)v  ’  n  °  '  n 
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<PK,nf>  R(0  2K+2)^*'t+)>R^0j  ~  (PK.nf ^(2K+2)^ t+^  =  ^PK,nf ^(2K+2)^ ^ ‘ 

Writing  R^q  2K+2)^*’t+^  =  ^(O)^t’  ^t  €  ^R(0)^’  ^°^ows  from  the 
isomorphism  between  H(R^)  and  H(Y^)  that 

<f'R(0.2K+2)(',t+'>Rj0j  =  E^a  Y(0) (s)Ms)ds-£ t] 

*  •£  EtY(0)(  =  )ft]hts)dS  =  Sha  ^{o_2K+2)(s'  t+)h(s)  ■ 
It  then  follows  that  for  t  €  T  , 
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c  nf-p  fnB  n  (2K+2). 
0  K.n  R{0) 


Since  lip„(t)|  £  c.  by  the  continuity  of  Pv(  t)  on  [a,b],  and  II  f — P„  fllD  < 
K  1  K  iv, n 


llfllD  ,  we  have  for  t  €  T  , 

R(0)  n 


lg(2K+2)^t^  *  C1  +  llfllR^M0,2K+2’ 


so  that  for  some  constant  c^, 


o  /MK+1  n_1  t ^ .  i  tf.i 

llf_PK.nfllR(0)=  (2K+2)  !  ^  ^  n’  ^^i  ,n,X^H^X’ ‘i+l  ,n^  g(2K+2) (x^h(x^  dx 


i  c2n 


-(2K+2) 


It  follows  that  for  some  constant  c^  the  second  term  is  upper  bounded  by 

c^n  (^K+3)  Therefore  the  second  term  is  o(n  (3K+2)j 

For  the  first  term,  since  each  H(ti  n>t)H(t,t1+j  n)  has  positive  sign  on 

(t.  .  t . . ,  ),  the  Mean  Value  Theorem  can  be  applied  to  write  it  in  the  form 
i,n  i+l,n' 


t-UK _  (K+l)!2  "j1  .  I 

(2K+2)!n2K+2  ‘2K+3>!  ii)  K  *•"  " 


where  t  <  f .  <  t  ,  .  Using  —  =  h(f.  )(t.,,  -t  ),  t  <  £\  < 

i.n  M.n  i+l,n  6n  vii,n'v  i+l,n  i.n'  i,n  si,n 

,  and  the  above  result  for  the  first  term,  we  obtain  by  Riemann 


i+1  ,n 
integrability, 


2K+2 

n 


Eci-din(Mr 


(~I )K(K+1 ) ?2  J> 
(2K+2) ! (2K+3) !  Ja 


PK(t) h(t)  dt. 


The  final  expression  of  the  asymptotic  constant  follows  from  Lemma  3  in 
BC  (1989).  0 

4.  SIMPLE-COEFFICIENT  ESTIMATORS 

Simple-coefficient  estimators  using  the  existing  K  q.m.  derivatives  of  X 
at  the  sampling  points  give  better  approximation  of  the  integral  I  than  the 
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simple-coefficient  estimators  (1.3)  which  do  not  use  these  q.m.  derivatives. 
These  estimators  are  based  on  the  trapezoidal  rule,  with  a  correction  term  that 
depends  on  the  values  of  the  q.m.  derivatives  of  X  at  all  sampling  points  of  a 
regular  sequence  of  sampling  designs,  i.e.  on  the  weighted  Rodriguez  formula. 
They  are  of  the  form-' 


(4  1)  I  (h)  -  )  1 .  j  _i _ ( 2K+ 1  j )  !  ^  PY  ft  11 

(4.1)  din(h)  -  (2K+2),  2^  ^j+1  ( j+1) ! (K-j) !  if0[Y(j)(ti,n)+(  1}  Y(J)(ti+l,n)]' 


where  the  h-weighted  q.m.  derivatives  Y^jj  of  Y  are  defined  as  in  Section  2- 

V Y/h-  Y(J)=Ya-i)/h-  J^1- 


and  superscript  denotes  q.m.  derivative.  Note  that  for  odd  j  the  i-sum 
telescopes  to  Y(J)(a>-YU)  (b) .  Their  asymptotic  performance  is  given  by 
Theorem  2  under  a  weaker  assumption  than  in  Theorem  1. 


Theorem  2.  Under  Assumption  A^,  we  have 

2 

2K+2  r  2  (K+l ) !2  rb  *  (t)aK(t)  ^ 

^  dXn{  ^  n  (2K+2) ! (2K+3) !  4.  h2K+2^  d 

If  h  is  proportional  to  (a^$^) then  the  remarks  on  the 
asymptotic  performance  and  optimality  following  Theorem  1  are  also  applicable 
here.  Assumption  A^  is  defined  as  follows,  and  the  comments  made  on  Assumption 
A^  in  Section  3  are  applicable. 


Assumption  A^  (K=0, 1 .2. . . . ) . 
the  following. 


Assume  (i),  (iii),  (iv)  of  A^  and  instead  of  ( i i ) 


( i i ) ‘  If  p.q  are  nonnegative  integers  with  p+q£2,  then  R^K+P'^+q^(s, t) 
exists  and  is  continuous  off  the  diagonal  of  the  square  [a,b]x[a,b]  (i.e.  for 
s*t);  at  the  diagonal  s=t,  r(^- K+l) ( t , t+j ,  ^(K.K+l)^  t~)  exist,  are  finite  and 
are  continuous  functions  of  t;  and  for  p,q£l,  sup  |R^+p'^+q^(s,  t)  |  <  ®. 

Sr  ^ 
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For  K=0,  the  simple-coefficient  estimators  have  only  a  "trapezoidal" 
component  (without  correction  term).  For  K=l,  they  have  a  correction  term  that 
depends  only  on  the  q.m.  derivatives  of  X  at  the  endpoints  of  the  interval 
[a,b],  and  after  approximating  these  q.m.  derivatives  by  finite  differences, 
the  resulting  estimators  are  identical  to  those  given  in  (1.3). 

The  weighted  q.m.  derivatives  in  (4.1)  can  be  approximated  by  the 
generalized  version  of  Newton’s  backward  and  forward  finite  difference  formulas 
for  regular  sampling  as  follows  (cf.  BC  (1989),  Krylov  (1962)) 

J. 


K 


YU)(tt.n>  SnJ  tl} 


for  i=0, 1 , . . . ,n-K, 


for  i=n-K+l , . . . ,n. 


where  W^(u)=u(u-1 ) . . . (u-0+1 ) .  0£1  (Wq(u)=1).  In  order  for  the  procedure  to  be 
"symmetric",  we  also  use  in  (4.1). 


Ym(ti+i.„>  ~  "J  jj  It  wlJ,(°)AtY(o)(',+i.„)  (° 


"J  ^  ir»|J)(0)A'Y(o}(tIti.{  n 


r  i=0 . K-2, 


)  for  i=K-l . n-1 


The  estimators  derived  from  these  approximations  and  (4.1)  are  of  the  form 


(4.2) 


1 


.1  (h)  =  -  I  b.  (^)(t.  ) 

d  nv  ’  n  i  vh  ,v  i,n; 


where  the  expressions  of  the  coefficients  b^  are  too  complicated  to  write  for 
general  K  (much  more  so  than  in  (1.4")).  Their  values  for  K=0, 1,2.3  (and 
appropriately  large  n)  are: 
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K 

=  0: 

1 

2' 

1. 

1. 

1. 

1. 

1. 

1 . 

.  .  .  .1. 

1. 

1. 

1. 

1. 

1. 

1 

2 

K 

=  l: 

5 

12’ 

13 

12’ 

1. 

1. 

1. 

1. 

1.  . 

.  .  .1. 

1. 

1. 

1. 

1. 

13 

12’ 

5 

12 

K 

9  * 

11 

143 

14 

121 

1. 

1. 

1.  . 

.  .  .1. 

1. 

1. 

121 

14 

143 

11 

—  4-i  • 

30’ 

120’ 

15’ 

120’ 

120’ 

15’ 

120’ 

30 

K 

529 

2263 

1327 

1721 

87 

83 

1.  . 

...1. 

83 

87 

1721 

1327 

2263 

529 

=  o  ■ 

1680’ 

1680’ 

1680’ 

1680’ 

84’ 

84’ 

84’ 

84’ 

1680’ 

1680’ 

1680’ 

1680 

We  conjecture  that  the  simple-coefficient  estimators  (4.2)  have  the  same 
asymptotic  performance  (1.1)  as  the  simple-coefficient  estimators  (1.3).  The 
example  in  Section  5  of  a  stationary  process  with  two  q.m.  derivatives  seems  to 
support  this  claim. 

The  asymptotic  constant  corresponding  to  the  optimal-coefficient 
estimators  or  the  simple-coefficient  estimators  (1.3)  that  do  not  use  the 
existing  K  q.m.  derivatives  is 


\E2K+2^  Pb 

( 2K+2 ) !  Ja  h2K+2(t) 


The  asymptotic  constant  corresponding  to  the  optimal-coefficient  estimators  or 
the  simple-coefficient  estimators  (4.1)  that  use  the  existing  K  q.m. 
derivatives  is: 

0  (K+l)!2  rb“K(t)*2(t) 

d  N  ~  (2K+2) !  (2K+3) !  Ja  h2K+2^ 


Their  ratio  depends  only  on  the  degree  of  smoothness  K: 


dS(  (K»1H2 

Ck  '  iB^uk^)! 


For  large  sample  sizes,  the  number  of  samples  required  for  a  given  mean  square 
error  when  using  estimators  with  and  without  q.m.  derivatives  are  related  by 
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d^K 

°K 


'dV 

l/(2K+2) 

.  Sc. 

1 

for 

K  =  0,  1 

.82 

for 

K  =  2. 

.60 

for 

K  =  3. 

.41 

for 

K  =  4. 

Thus,  the  performance  improvement  of  the  estimators  that  use  q.m.  derivatives 
over  those  that  do  not  increases  as  the  number  of  q.m.  derivatives  K  increases. 


Proof  of  Theorem  2.  For  simplicity  we  write  1^  for  ^I^fh).  In  view  of  the 
isomorphism  between  H(R^qj)  and  H(Y^q^).  the  mean  square  error  is  written  as 
fol lows 


E( I  -  I  )2  =  Ilf  II2 
v  n7  n  R 


(0) 


where 


fn<'>  -  EC^ou-y] 


n-1  K 


~  ^a  R(0)(t,s)h(s)ds  ^  ^  J+l  Fj.K[R(0,  j)(t,ti)  +  (  1>jR(0.j)(t'ti  +  l)] 


and 


Thus,  for  K  ^  0, 


F  =  1HULU (2K- j+1 )  ! 

rj.K  "  (2K+2) !  (K-J)!(J+1)!  ' 


e ( i — i  r  =  <r  ,f  >D 

n7  n  n  R 


(0) 


n-1  K 


Ja  ^  ^  K  C(fn), jjO.)  *  <-»J(fn)(J)(«1M)] 


.  n-1  t,  . 

1  r  r  1  *  1 


K+  1 


rawsyr,!'.  <  rn>,K.i  ,<  >  >h< c  >rft 

1  1 


by  Proposition  1  with  m  =  K+l  Integrating  by  ports  we  obtain 


f"  'n'2  -  UKTTr^!  1 

1  1 
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"  Jt|+1  dK+2Wti-t)H^t'ti  +  l^K+1(fn)(K)  (Oh(t)dt  } 


Applying  Proposition  1  to  the  integral  of  R^Q)(t.*)  in  the  expression  of 


f  .  we  obtain 
n 


n-1  t 


f„<'>  -  (2KT2J T  ^  VK*l)(Ulh,S),IS' 


and  taking  the  weighted  derivative,  we  have 

n-1  t 


(fn)(K)^)  = 


(2K+2) !  j!0  dK+ltH(tj«s)H(s- tJ+i)]  R(K,K+1)(t;'S)h{s)dS- 


Now  we  show  that  (fn)^j(t^)  =  ( *  n)  +  ^ )  =  0-  Indeed,  using  the  following 

function  which  was  introduced  in  the  proof  of  Proposition  1, 

1  K+ 1 

p(0)(t;ti,t:i  +  i)  =  (K+l ) !  dK+ 1  c  i  •  t)H(  t  •  f  i  +  i )  J 

and  its  explicit  expression  there,  we  have 


n-1  t 


(fn^(K)^i^  =  ( 2K+2 ) !  ^  ^tj  P(0)^ s ;  C j  ' 1  j+1  ^R(K.K+1 ) ^ r  i  ’  s)h( s) 


ds 


-  (*♦!)!  (KO+t)!(-l)*  1 _  ^  ,lJ.I  I.  „  s)h(s)ds 

(2K+2) !  ^  (Kt,.f),  g , 2  nK*l-f  ^  Jtj  H  tj‘s"(K.K+l)tl*shs  ds 


Applying  the  Mean  Value  Theorem,  we  have 

K+l 


J  n-1 


(f  )  )  -  (fru !-  J_  Y  -  (k+  i+f ) ■  (- 1 )  Y  R  (t  b , 

n  K)  (2K+2) !  nK+2  ^  (K+1_,}!  ,,2(,+1)  ^  R ( K . C i ’ b j > 


where  +  i  By  taking  h  to  be  the  uniform  density,  the  h-*eighted 

polynomial  P^^(  t ;  t^ .  t ^  +  j )  becomes  the  classical  Legendre  polynomial 
1  V+ 1  K+ 1 

. v  : . ,  IT  [u(l-u)]  over  the  interval  [0.1 J  and  therefore 

f‘  nK‘1[.,(i-..)]K“d„  =  i  LKtlillL  (-»/  ,»  ,/  d»  =  i  JKHtiHAzUL 

•Z  {)  »  -  '  »'  •  "^(P*  1 


P=0  (K+l-f)!  i\‘ 


f=0  (K+l-f ) !  P !  (f+1) 


and  since 
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rl  —K+lp  .  -.K+l  ,  fnKr  % -iK+1 ,  .. 

S0  D  [U(l-u)]  du  =  {D  [u(l-u)]  }0  =  0. 

it  follows  that  (f  ),„%(t.)  =  0,  and  likewise  (f  ),,rx(t.  .)  =  0-  Thus  the 
v  n'(K)v  i ’  v  n'(K)v  i+l' 

2 

first  term  in  the  expression  of  the  m.s.e.  E{ I— I  )  vanishes  and  we  can  write 


e( i-i  )  =  - 

v  n' 


i  n;‘  /i+i 


(2K+2) !  ^  P(i)(t:ti'tlti)(fn)(K)<t>h(t)<it' 


Replacing  { f n) (K) ( t )  by  its  expression,  the  m.s.e.  is  decomposed  into  two 

terms:  the  diagonal  terms  1.  M.  .  and  the  off-diagonal  terms  7.  M.  .. 

&  i  i.i  6  i/J  i . J 

Diagonal  terms  M,  . . 


x*i«  P  (s:t  ,  1 

(2K+2)!2  Ci  1  1  1  li  s  J 


P(l)^t: ti  *  ti  +  l^ 


R(K iK+l)(t,s)h{t)h(s)  dtds- 


Using  the  expression  of  j ^ ( t ;  t_  , +  j )  In  the  proof  of  Proposition  1,  and 
integrating,  we  obtain  from  the  Mean  Value  Theorem 

K+ 1  P 

M  -  -  i*+LLL  -  J  (K*w)?(-Dg _ 1 _ 

(2K+2)!  e=l  (K+l-e) !  e\{e-l)'.  n 


*  j  St*  P(0)(s;Wl>  J  H  (Vs)R(K,K+l)(Vs)h(s)  ds 

+  ^tt  P(0)^S:  ti'  S+l^  I  JT  "  H  ^ri,s)  R(K.K+l)^s'S^h^S^  ds| 


where  t,  <  n  <  s  <  n'  <  t,  From  the  expression  of  P,.,(s: t, , t. , . ) 

i  's  's  i  +  1  K  (0)v  l  i  +  1' 


and  the 


Mean  Value  Theorem,  we  have 


(**1)!2  K2] 

(2K+2) *2  e=l  (K+1-0) !  e\2 


e  _1 _  "*y  *  (K+l+p)  !  (-1  )K  _J _ 

K+l-e  ..  ,2  K+l-p 

n  p=0  (K+l-p) !p!  n 


x  <  R 


'(K.K*»(V‘i>  HP*'<V5>h<5>  ds 
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R(K.Ktl)ini  al>  [  h  -  He(t1.s)]np(t1.s)h(s)  ds  j 


.here  t,  <  n,  <  a,  <  t,  <  a;  <  pj  < 


(K+nr  i 

(2K+2) ! 2  n2K+3 


»<*(K  K.n^i^)^1  (K+1+m  (~2)gK^  ^?!  H1*  — 

1  ;  0=1  (K+1-0) !  e \  p=0  (K+l-p)!  p!  p+0+1 


+  R 


(n'.a'I  K;‘  M)*  K;‘  (Krl+p) !  (-1)P  f  1 _ 1 

(K.K+1)  i  i  g=l  (K+1_£),  g[2  p=Q  (K+1_p),  p,2  (p+1  V+e 


p=0  (K+l-p)!  p! 


p+0+1 


We  now  concentrate  on  the  coefficients  of  K+l)^i,ai^  311(1  R(K  K+lJ^i 
We  have 


.•  -a 


rl  nK+ 1  r  ..  .-iK+1  ,  ru  nK+2r  . -.K+l  , 

D  [u(l-u)J  du  JQ  D  [v(l-v)J  dv 


Ktl  (K+1+0)!  (-1)*  A  „K+lr  ,,  ,-,K+l  ,  ru  ve  1 

(K  1)!  ell  (K*i-|)!<!  J0°  tu(i-u)]  du/opriyi 

.  (K+ 1 )  !2  Kl'  t1^)'  I'1)'  Kj‘  (KH.p)!  (-I)p  j.1  UP+C  du 
0=1  (K+1-0)!  er  p=0  (K+l-p)!  p!2  0 

=  (K+l)t  Kj‘  (K-rl+g) !  (-1)*  K:‘  (K+l.p) !  (-l)p  1 

0=1  (K+1-0) !  0!2  p=0  (K+l-p)!  p!2  p+0+1 


0-1 


dv 


and  also  by  repeated  integration  by  parts  we  have 

rl  nK+lr  , ,  . ,K+1  ,  ru  nK+2r  . ,  , -,K+1  , 

SQ  D  [u(l-u)]  du  JQ  D  [v(l-v)]  dv 

=  (-1)K+1  X1  [u(1-u)]K+1  d2K+2[u(1-u)]^+1  du 

=  (-1)K+1  (-1)K+1  ( 2K+2 ) !  B(K+1  ,K+1 )  =  . 

Equating  the  two  right  hand  sides,  we  find  that  the  coefficient  of 

R(K.K.l)(Val>  ls 
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Also, 


(K+ 1 ) ! 2  1 

(2K+2) ! (2K+3) !  n2K+3  ' 


c 1  nK+ 1  r  , ,  + ,K+ 1  ,  rl  nK+2  r  + ,K+ 1  , 

J0  D  [u(l-u)]  du  Ju  D  [v(l-v)]  dv 


K+l 


e-i 


%  (K+l+£)!  (-1)"  P1  ^K+l  r  ,,  ^K+l  ,  fl  v 
=  (  0  t!i  (K^wjr  et  so°  [u<'-u)]  du-rumrrdv 


(f-nt 


=  (Kti),2  K;‘  K;‘  ikhie n  i-')p  ;i  up(1./)  dU 

£=1  (K+l-£) !  er  p=0  (K+l-p) !  p ! ^  u 


=  (K+l )  !2  Kj‘  (K*l^)!  (-l)g  K*’  (K+l+p)!  (-l)p  I  1 

l i  p  ~  >*'  «  '  •  *2 


e=\  (K+1-0) !  ( !  p=0  (K+l-p) !  p ! ‘ 


1 


p+1  p+£+l 


and  repeated  integration  by  parts  gives 


rl  J<+lr  ,,  ,-,K+l  ,  pi  J<+2r  ,,  ,-,K+l  ,  (2K+2) !  (K+l)! 

X0  D  [u(l-u)]  du  Ju  D  [v(  1-v) ]  dv  =  -  1 - (2X7.3) ! - 


Equating  the  two  right  hand  sides,  the  coefficient  of  K+l)^ni'ai^  becomcs 

( K+ 1 ) ! 2 


(2K+2) ! (2K+3) !  n2K+3 


Therefore 

M. 


_  (K+l ) ! _ 1 _  .  , 

i.i  “  (2K+2) !  (2K+3) !  2K+3  1  (K+l  ,K)'ai  ,T?i '  “  (K+l,K)lW  ' 


1 


Using  —  =  )( i ) •  <  fj  <  tj+j.  we  obtain  by  Riemann  integrabi 1 i ty . 


n  ^  Mi , i  n  (2K+2) !  (2K+3) !  4  ^(K+l.K)^  * t)_R(K+l ,K)( t+* tJ^h( 1 )dt 

(K+l)!2  rb  ^(t) 

=  (2K+2) !  (2K+3) !  Ja  h2K+2(t) 

(by  Lemna  2  in  BC  (1989)). 


Off-diagonal  terms  M  ,  i*j. 

*  •  J 

Integration  by  parts  gives 
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J'ti  P(l)(t;ti,ti  +  1^  R(K.K-t-l)^t,S^h(t)  dt 

=  P(0)(ti+l;ti,ti+P  R(K.K+l)(ti+l,S)  "  P(0)^ti:ti,ti+l^R(K,K+l)(ti,S^ 


i  +  1 


Xt.  P(0)^t:ti,ti  +  PR(K+1.K+1) 


( t , s)h( t )  dt , 


so  the  off-diagonal  term  becomes 


M. 


i.J 


(2K+2) !2  [  ;tj  1  [P(0){ti+l: S1 ti+l)R(K.K+l)^ti+l,s) 

“  P(0)(ti:ti,ti+l)R(K.K+l)(ti,s^  P(0)(s:tj’ tj+l)h(s)  ds 
•fti  ^tj  P(0)^t:ti*ti+l^P(0)^s:tj*tj+l^R(K+l.K+l)^t,S^h^t^h^S^dtds 


The  first  term  has  already  been  shown  to  be  identically  zero.  Thus,  we  have 

Mi.J  =  (2K+2)  !2  Xti  St J  P(0)(t;VtW)P(0)(S:VVl) 

X  R(K+l.K+l)^t,S^h^t^h^S^dtds 


,2  K+l 


K+l 


( K+ 1 ) !  **  ■';*  (K+l+£)!(-l)"  1  (K+l+p)!(-l)P  1 

n  "  n  i  n  ^  . 


(2K+2)!2  e=0  (K+l-£) !  V2  nK+1  *  p=0  (K+l-p)!  p!2  nK+1  p 

X  St\+1  Xtj+1  H^ti't)HP(ti's)R(K+l,K+l)(t's)h{t)h{s)dtds 
Applying  the  Mean  Value  Theorem,  we  obtain 


M  (K+l)!2  1  (K+l+l)?(-l)* 

ni,j  =  9  9X4-4  2  fK+l-ZM!  p\(P4- 


(2K+2)!2  n2**4  eto  {K+1“')!  *!(*+1)! 
K+l 


-J*  (K+l+p) !  (-1  )p  R  (a  b  ) 

p=Q  (K+1_P)!  P • ( P+ 1 ) •  (K+l.K+l)lai.«,DjV 


where  t^a^^t,^.  Wp^j+r 


It  follows  that 
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5.  EXAMPLE 

We  consider  the  approximation  of  the  integral 

T  =  f *  ePtX(t)dt. 

where  the  stationary  process  X  has  covariance 

2 

R(t,s)  =  {  1  +  o|t-s|  ♦  —■ (t-s)2  }  e 

with  spectral  density  -p(X)  =  (8aTV3ir)(a2  +  \2)  ^ ,  and  thus  exactly  K=2 
mean-square  continuous  q.m.  derivatives.  When  0/0.  the  density  that 
generates  the  asymptotically  optimal  design  is 

h*(  t )  =  (20/7){e2/5/7-l)_1  .  0^  t  <  1  . 


and  the  corresponding  sampling  points  are 

t*  n  =  (7/20)  fn[l  ♦  (e^-l)i/n],  1=0. 


The  sample  size  of  the  design  is  N=n+1.  For  simplicity  of  notation  we  will 

write  t.  for  t, 

i  i  .n 

The  simple-coefficient  estimators  (14).  with  K=2.  which  do  not  use  the 


two  existing  q.m. 
n6  E(I-In)2  *  C2 


derivatives,  are  denoted  by  I  The  asymptotic  constant  ir. 
has  the  following  expression  under  the  asymptotically  opt im 


design 
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_«  d  ,rlr  .  .  2/3 1 1  /7  , ^  ,7  7 

C2  =  gT  {-T0Ca2(t)e  J  dt  }  =  t  a  /5670  . 

(  a2(t)  =  16a5/3.  Bg  =  1/42.  -r  =  (7/20) (e2P/7-l )  ).  and  has  the  following 
expression  under  the  uniform  design 


c2  =  g?  *o  °2(t)e2Ptdt  =  (e2P-l)/11340. 


The  optimal-coefficient  estimators  (3.1)  which  use  the  existing  two  q  m. 

derivatives  at  the  sample  points  (t^  n}^_Q  are  denoted  by  ^1^.  The 

simple-coefficient  estimators  (4.1)  which  use  the  existing  two  q.m.  derivatives 

at  the  sample  points  ( t*  }?  _  have  the  form: 

i  ,  n '  i =0 


,*  1,1 


n-1 


d'n  =  S-|  ?V(0)(°>  *  *ml  Y(0)(',.„>  *5Y(0)(1)  >  *^2  (Y(1)(°)-Y(1)(1» 


where 


+  2  Y(2)(0)  *  {^lY(2)(Ci.n-  +  2  Y(2){1)  } 


Y(0)(t)  =  ,e(5P/7)t  X(t). 

Y(i)(0  =  A{3p/7)t  (  f§X(t)  ♦  X  (t)  }. 

Y(2)(0  =  (  5^  X(t)  ♦  gfi.  x  (t)  ♦  X"(t)  ). 


The  asymptotic  constant  under  the  asymptotically  optimal  design  in 

fv,.  :**  2  **  .  ,  6_..  .**  2  „♦»  . 

n  F ( I  -  .  I  )  — »  ,C0  and  in  n  E ( I  —  ,  I  )  — *  ,C0  is 
d  n  d  2  v  d  n'  d  2 

„**  1  rflr  20t.1l/7Ji,7  7  5,,orwi 

dC2  =  100800  {/ota2(t)e  ]  dt}  =  ^  a  /1890°- 

The  simple-coefficient  estimators  (4.2)  with  K=2.  which  use  the 

approximated  existing  two  q  m.  derivatives  at  the  sample  points  (t^  are 

denoted  by  .1 
d  n 

When  0  is  close  to  zero,  the  asymptotically  optimal  sampling  design 
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becomes  close  to  periodic  design.  The  improvement  in  performance  of  the 

asymptotical ly  optimal  design  over  the  uniform  design,  when  either  estimators 

I  or  ,1  are  used,  increases  with  0.  We  select  a  moderate  value  of  0  =  3  to 
n  d  n 

differentiate  between  the  two  sampling  designs. 

For  small  values  of  a  (highly  correlated  observations)  the  normalized  mean 
square  errors  are  very  small;  for  example  when  a  =  5,  a  sampling  design  of  size 

_3 

3  gives  a  normalized  m.s.e.  of  order  10  For  large  values  of  a  (weakly 

correlated  observations)  the  normalized  m.s.e. ’s  are  significantly  higher;  for 

example  when  a  =  20,  a  sampling  design  gives  a  normalized  m.s.e.  of  order  .3. 

The  normalized  m.s.e. 's  corresponding  to  the  optimal-coefficient 

estimators  and  simple-coefficient  estimators  that  use  the  two  existing  q.m. 

derivatives,  E( and  E( along  with  the  asymptotic 
_ ^  ^  2 

expression  n  ^Cg/EI  ,  are  plotted  versus  the  sample  size  N=2 . 20  in 

Figure  1  for  a  =  15,  0=3.  It  is  seen  from  Figure  1  that  for  small  sample 

A 

sizes  the  optimal-coefficient  estimators  ^1^  outperform  (as  expected)  the 

simple-coefficient  estimators  ^1^.  However,  for  moderate  n  their  performance 

is  nearly  Identical  and  very  close  to  their  asymptotic  performance. 

The  normalized  m.s.e. ’s  corresponding  to  the  two  simple-coefficient 
2  2  —  2  2 

estimators,  E( I— 1^ )  /El  .  E( I — ^ I n )  /El  •  along  with  the  asymptotic  expression 
_0  2 

n  Cg/EI  •  are  Plotted  versus  the  sample  size  N=2 . 20  in  Figure  2  for 

a  =  15,  0=3,  under  both  the  asymptotically  optimal  (*)  and  the  uniform  (u) 

sampling  designs.  It  is  seen  from  Figure  2  that  the  asymptotically  optimal 

design  provides  better  performance  than  the  uniform  design.  It  is  also  seen 

that  the  m.s.e. ’s  of  the  two  simple-coefficient  estimators  I  and  ,1  are 

n  d  n 

almost  identical  for  all  computed  sample  sizes,  thus  suggesting  that  ^1  has 

the  same  asymptotic  performance  as  I  . 

n 

Comparing  Figures  1  and  2,  we  see  that  the  estimators  that  use  the 
existing  q.m.  derivatives  have  better  performance  than  those  that  do  not  for 
moderate  and  large  sample  sizes.  Table  1  shows  the  number  of  samples  N 
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required  to  achieve  a  specified  performance  under  different  designs  and 
estimators . 
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Table  1.  Number  of  samples  N  required  to  achieve  a  specified 

performance  under  different  designs  and  estimators  for 
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